CALCULATING CAMERA OFFSETS TO FACILITATE OBJECT POSITION 
DETERMINATION USING TRUNGULATION 


Field Of The Invention 

The present invention relates generally to target acquisition and in 
particular to a method of calculating camera offsets to facilitate object position 
determination using triangulation. 

Background Of The Invention 

Touch systems are well known in the art and typically include a touch 
screen having a touch surface on which contacts are made using a pointer in order to 
generate user input. Pointer contacts with the touch surface are detected and are used 
to generate corresponding output depending on areas of the contact surface where the 
contacts are made. 

In co-pending U.S. Patent Application No. 09/610,481 filed on July 5, 
2000 for an invention entitled "Passive Touch System and Method of Detecting User 
Input", assigned to the assignee of the present invention, the content of which is 
incorporated herein by reference, a touch system is disclosed. The touch system 
includes a touch screen coupled to a master controller and a computer coupled to the 
master controller. The computer executes one or more application programs and 
provides display output that is presented on the touch screen. The touch screen, 
master controller, computer and projector form a closed-loop so that user contacts 
with the touch screen can be recorded by the computer as writing or drawing or used 
to control execution of application programs executed by the computer. 

The touch screen includes a touch surface in the form of a rectangular 
planar sheet of material bordered by a rectangular bezel or frame. A two-dimensional 
digital signal processor (DSP) based CMOS digital camera is mounted adjacent each 
comer of the touch screen. Each digital camera is aimed at the touch screen so that its 
field of view encompasses a designated edge of the touch surface. In this way, the 
entire touch surface is within tht fields of view of the digital cameras. The fields of 
view of tile digital cameras also overlap so that a pointer in close proximity to the 
touch surface appears witiiin the fields of view of at least two of die digital cameras. 
This allows the position of such a pointer relative to the touch surface to be calculated 
using triangulation. 
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EHiring operation of the touch system each digital camera acquires 
images of the touch surface within its field of view at a desired frame rate. The 
acquired images are processed by the digital cameras to determine if a pointer is in the 
acquired images. When a pointer is in an acquired image, the acquired image is 
5 further processed by the digital camera that acquired the image to determine the 
median line or tip of the pointer within the acquired image. Hie median line or tip of 
the pointer is represented by a number. TOs pointer information is converted into a 
pointer information packet (PIP) by the digital camera and the PIP is queued for 
transmission to the master controller. 
10 The master controller polls the digital cameras for PIPs. When the 

master controller receives a PIP, the master controller divides the number representing 
the median line or tip of the pointer by the resolution of the digital camera. The 
master controller then multiplies this result by field of view (FOV) of the digital 
camera and then subtracts a fixed error correcting calibration angle 5 to yield an angle 
15 (|>. The calculated angle <t> is presumed to be the angle formed between the designated 
peripheral edge of the touch screen encompassed in the field of view of the digital 
camera that generated the PIP and a line extending from the optical axis of the digital 
camera that intersects the pointer within the image. 

As mentioned above, the aiming of the digital cameras ensures that 
20 when a pointer is brought in close proximity to the touch screen, the pointer is 
captured in images acquired by at least two digital cameras. As a result when a 
pointer is brought in close proximity to the touch screen, at least two PIPs are 
received by the master controller and hence, two angles are calculated by the master 
controller. With two angles available, the master controller determines the 
25 intersection point of the lines extending fi-om the optical axes of the digital cameras 
which generated the PIPs, that intersect the pointer within the acquired images. Using 
triangulation the position of the pointer relative to the touch screen in Cartesian 
coordinates is calculated. The master controller in turn transmits this pointer position 
data to the personal computer. In this marmer, the pointer position data transmitted to 
30 the personal computer can be recorded as writing or drawing or can be used to control 
execution of application programs executed by the computer. The computer also 
updates the display output so that information presented on the touch surface reflects 
the pointer activity. 
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As mentioned above, each digital camera is mounted adjacent a corner 
of the touch screen and aimed so that its field of view encompasses a designated 
peripheral edge of the touch surface. Ideally, the extremity of the field of view of 
each digital camera extends slighdy beyond the designated peripheral edge of the 
5 touch screen by a known amount so that the angles calculated by the master controller 
are based on a reference frame that corresponds to the touch screen. However, in 
reality the fields of view of the digital cameras are angularly offset with respect to the 
peripheral designated edges of the touch screen by unknown amounts due to 
mechanical tolerances, optical effects and digital camera placement. 

10 In the touch system described above, during calculation of the angles a 

fixed error correcting calibration angle 5 is subtracted from the calculated angles to 
take into account the angular offsets of the digital cameras. Tliis calibration of course 
assumes that the angular offsets of the digital cameras are known and equal. 
Unfortunately, the angular offset of each digital camera usually differs. Also, the 

15 angular offset of each digital camera may change during shipping, installation etc. of 
the touch system. As a result, the angular offsets of the digital cameras are typically 
not properly compensated for by the fixed error correcting calibration angle. Unless 
the actual angular offsets of the digital cameras are known, when the position of a 
pointer relative to the touch surface is calculated using triangulation based on the 

20 calculated angles, the calculated position may be significandy different than its actual 
position. To complicate matters the calculated position of the pointer may vary 
significandy depending on the pair of digital cameras whose image data is used to 
triangulate the position of the pointer. As will be appreciated, this makes it difficult 
to calculate accurately the position of a pointer relative to the touch screen. In an 

25 interactive system where the touch screen is mapped to a computer display so that 
contacts on the touch screen can be used to invoke computer functions, accurately 
determining the contact position of the pointer on the touch screen is extremely 
important. 

It is therefore an object of the present invention to provide a novel 
30 method of calculating camera offsets to facilitate object position determination using 
triangulation. 


Summary Of The Invention 

According to one aspect of the present invention there is provided a 
method of determining the position of an object relative to a reference frame from 
5 captured images of the object based on triangulation, the captured images being taken 
by at least two cameras having overlapping fields of view within said reference frame, 
at least one of said cameras having an offset angle causing an extremity of the field of 
view thereof to extend beyond a boundary of said reference frame, said method 
comprising the steps of: 
10 capturing an image of the object using each said at least two cameras at 

at least one location within said reference frame; 
for each location: 

determining the position of the object within each image and 
for each image placing the determined position into a coordinate system 
15 corresponding to that of said reference frame; and 

processing the determined positions to determine at least one of the 
position of the object at each location and the offset angle of said at least one camera. 

According to another aspect of the present invention there is provided 
a method of determining the position of an object relative to a reference frame from 
20 captured images of the object based on triangulation, the captured images being taken 
by at least two cameras having overlapping fields of view within the reference frame, 
an extremity of the field of view of each said at least two cameras encompassing a 
boundary of said reference frame, at least one of said cameras being offset causing the 
extremity of the field of view thereof to extend beyond said boundary, said method 
25 comprising the steps of: 

determining the position of the object within each image, the position 
of the object within each image being represented by an angle, said angle being equal 
to the angle formed between the extremity of the field of view encompassing the 
boundary of said reference frame and a line extending from the camera that intersects 
30 the object within the image; 

determining the offset angle of said at least one camera; 
subtracting the offset angle from the angle representing the position of 
the object within the image taken by said at least one camera to calibrate the angle; 
and 
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using the calibrated angles to calculate the position of the object with 
respect to the reference frame using triangulation. 

According to yet another aspect of the present invention there is 
provided a touch system including at least two cameras having overlapping fields of 
5 view and a processor to process image data of said at least two cameras, where the 
position of an object that is within the overlapping fields of view relative to a 
reference frame is determined by triangulating object position data captured in an 
image acquired by each camera, a method of calibrating the touch system comprising 
the steps of: 

10 determining the offset angle of each camera relative to the reference 

frame; 

using the offset angle to calibrate the object position data; and 
using the calibrated object position data during triangulation to 
determine the iK)sition of said object relative to said reference frame. 
15 According to yet another aspect of the present invention there is 

provided a touch system including a reference frame, and at least two cameras having 
fields of each that overlap within said reference frame, wherein the position of an 
object relative to the reference frame is determined from captured images of the 
object based on triangulation, and wherein the fields of view of said at least two 
20 cameras are rotated with respect to the coordinate system of said reference frame to 
define offset angles, a method of calibrating said touch system comprising the steps 
of: 

capturing an image of the object using each said at least two cameras at 
at least one location within said reference frame; and 
25 for each location : 

determining the position of the object within each image, the 
position of the object within each image being represented by an angle ^, said angle 
being equal to the angle formed between an extremity of the field of view extending 
beyond the reference frame and a line extending fix)m the camera that intersects the 
30 object within the image; and 

mathematically calculating the offset angles of said at least two 
cameras based on the angle determined for each image and the position of said at least 
two cameras relative to the coordinate system assigned to said reference frame. 
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According to still yet another aspect of the present invention there is 
provided a touch system comprising: 

a generally rectangular reference frame surrounding a touch surface, 
one comer of the reference frame defining the origin of a coordinate system assigned 
5 to said touch surface; 

a camera adjacent each comer of the reference frame, each camera 
being aimed towards said touch surface and capturing images of said touch surface 
within the field of view thereof, fields of view of said cameras overlapping within 
said reference frame, the fields of view of said cameras being offset with respect to 
10 said reference frame; and 

a processor processing the captured images and generating object 
position data when an object appears in images, said processor determining the 
position of said object relative to said origin in rectangular coordinates using said 
object position data based on triangulation, wherein said processor further executes a 
15 calibration routine to determine offset angles of said cameras, said offset angles being 
used by said processor to adjust said object position data prior to said position 
determination. 

According to still yet another aspect of the present invention there is 
provided a computer readable media including a computer program th»:eon for 

20 determining the offset angles of cameras at different positions along a reference 
rectangular coordinate system based on object position data generated by said 
cameras, the object position data generated by each camera representing the position 
of an object within the field of view of said each camera at least one location within 
the fields of view of said cameras, said computer program including: 

25 computer program code for relating the object position data generated 

by each camera to said rectangular coordinate system; and 

computer program code for mathematically calculating the offset 
angle of each camera based on the related object position data and the position of said 
cameras relative to said coordinate system. 

30 The present invention provides advantages in that since the actual 

digital camera offsets are calculated in real time, the fields of view of the digital 
cameras can be referenced to a reference frame that corresponds to the touch screen. 
In this manner, when the position of an object within the fields of view of a pair of 
digital cameras is calculated using triangulation, the calculated position of the object 
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corresponds to a high degree of accuracy with the actual position of the object relative 
to the touch screen. Also, since the digital camera offsets are calculated 
mathematically with a high degree of accuracy in a calibration routine that is executed 
after installation of the touch system, the need for precision mounting of the digital 
5 cameras during manufacturing is relaxed. Since mechanical tolerances with respect to 
digital camera mounting can be relaxed, touch systems of this nature can be 
manufactured more quickly and less expensively while ensuring higji resolution. 

Brief Description Of The Drawings 

10 An embodiment of the present invention will now be described more 

fully with reference to the accompanying drawings in which: 

Figure 1 is a schematic diagram of a touch system in accordance with 
the present invention; 

Figure 2 is a front view of a touch screen forming part of the touch 
15 system illustrated in Figure 1 showing camera offset angles; 

Figure 3 is a front view of another embodiment of a touch screen; and 
Figure 4 is a front view of yet another embodiment of a touch screen. 

Detailed Description Of The Preferred Emhndlment 

20 Turning now to Figure 1, a touch system of the type described in co- 

pending U.S. Patent Application No. 09/610,481 is shown and is generally identified 
by reference numeral 50. As can be seen, touch system 50 includes a touch screen 52 
coupled to a digital signal processor (DSP) based master controller 54. Master 
controller 54 is also coupled to a computer 56. Computer 56 executes one or more 

25 application programs and provides display output that is presented on the touch screen 
52 via a projector 58. He touch screen 52, master controller 54, computer 56 and 
projector 58 form a closed-loop so that user contacts with the touch screen 52 can be 
recorded as writing or drawing by the computer 56 or used to control execution of 
application programs executed by the computer 56. 

30 Figure 2 better illustrates the touch screen 52. As can be seen, touch 

screen 52 includes a touch surface 60 boidered by a rectangular frame 62. Touch 
surface 60 is in the form of a rectangular planar sheet of passive material. A DSP- 
based CMOS digital camera DCcam is mounted adjacent each comer of the touch 
screen 52. Each digital camera DQam is aimed towards the touch surface 60 so that 
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its field of view encompasses a designated peripheral edge of the touch surface 60. In 
the designation shown in Figure 2, the fields of view of digital cameras DCq and DC3 
encompass the lower horizontal edge 60a of the touch surfece 60 while the fields of 
view of digital cameras DCi and DC2 encompass the upper horizontal edge 60b of the 
5 touch surface 60. 

Due to mechanical tolerances, optical effects and digital camera 
placement relative to the touch surface 60, the field of view of each digital camera 
DCcam is typically angularly offset widi respect to the designated peripheral edge of 
the touch surface 60 that the field of view encompasses. Hie angular offset of each 

10 digital camera is designated by angle Scam- 

During operation of the touch system SO, each digital camera DCcam 
acquires images of the touch surface 60 within its field of view at a desired frame rate. 
The acquired images are processed by the digital cameras DQam to determine if a 
pointer is in the acquired images. When a pointer is in an acquired image, the 

15 acquired image is further processed by the digital camera that acquired the image to 
determine the median line or tip of the pointer within the acquired image. Hie median 
line or tip of the pointer is represented by a number. This pointer information is 
converted into a pointer information packet (PIP) by the digital camera DCcam and the 
PIP is queued for transmission to the master controller 54. Specifics concerning the 

20 image processing described above are set out in co-pending U.S. Patent Application 
No. 09/610,481, incorporated herein by reference. 

The master controller 54 polls the digital cameras for PIPs. When the 
master controller 54 receives a PIP, the master controller uses the number 
representing the median line or tip of the pointer and the field of view of the digital 

25 camera to calculate an angle ^cam using the equation: 



(0.1) 


where: 

X is the number representing the median line or tip of the pointer; and 
30 a is the total length enclosed by the field of view (FOV) of the digital 

camera at a distance from the digital camera. 
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The calculated angle ^tam is equal to the angle formed between the 
extremity of the field of view extending beyond the designated peripheral edge of the 
touch surface 60 of the digital camera that generated the PIP and a line extending 
from the optical axis of the digital camera that intersects the pointer within the image. 
5 Preferably, the extremity of the field of view extends beyond the designated 

peripheral edge (i.e. in this case the x-axis) of the touch surface 60 within the field of 
view by a known amount. However, in almost all cases the angular offset of each 
digital camera DC is different and unknown. 

When a pointer is brought in close proximity to the touch surface 60, 

10 the pointer is captured in images acquired by at least two digital cameras. As a result, 
at least two PIPs are received by the master controller 54 and hence, two angles (frtam 
are calculated by the master controller 54. With two angles ^cam available, the master 
controller 54 can determine the intersection of the lines extending from the optical 
axes of the digital cameras which generated the PIPs, that intersect the pointer within 

15 the acquired images. Using triangulation the position of the pointer relative to the 
touch screen in Cartesian coordinates can be accurately calculated if the amount that 
the extremities of the fields of view of the digital cameras DC cam extend beyond the 
designated peripheral edges of the touch surface 60 are known. However because the 
angles ^csm are angularly offset with respect to the designated peripheral edges of the 

20 touch surface by unknown amounts, calculating the position of the pointer in this 
manner does not accurately determine the actual position of the pointer relative to the 
touch suiface 60, As a result, it is necessary to calibrate the touch system 50 to take 
into account the angular offsets 5cam of the digital cameras DCcam so that the actual 
position of the pointer relative to the touch surface 60 can be determined. 

25 To calibrate the touch system 50, it is necessary to convert each 

calculated angle <^am into a rectangular position (Xi, y,) on the touch surface 60. 
Relationships exist between the coordinates (Xi, yO on the touch surface 60 and the 
angles ^cam that allow this conversion to be performed. If the origin of touch screen 
coordinate system is taken to be at digital camera DCo, and the horizontal and vertical 

30 dimensions of the touch screen are taken to be Bx and By respectively, the following 
equations apply: 

t^(^'S^) = ^ (0.2) 
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tan(<^-^i) = ^^^ (0.3) 


t^i02-S,)^^^ (0.4) 


ton((ft,-cy3) = -^ (0.5) 

In order to reference each angle ^cam to a common reference frame that 
corresponds to the touch screen coordinate system and develop a single equation that 
applies to all four digital cameras DCcam> it is necessary to change some definitions in 
the above equations. First, introduce a set of angles 3cam defined by: 

fiamT^ccm-^cam (0.6) 

The angles pcam are the angles ^cam but referenced to the designated 
peripheral edges of the touch screen, in this case the horizontal edges 60a and 60b. 
Next introduce a set of angles Ocam which are referenced to the y-axis of the touch 
screen coordinate system and are related to the angles Pcam as follows: 

(0.7) 

3^ ^ 

«1=Y + A (0.8) 
«2=f-A (0.9) 
^=f+A (0.10) 

Finally, introduce a third set of angles dkam that are related to the 
angles Ocam as follows: 

^aun^a^-^cc. (0.11) 

Replacing the angles Ocam with their defiiutions set out in equations (0.7) to (0.10) and 
replacing the angles pcam by the definition set out in equation (0.6), allows flie angles 
oVam to be expressed as follows: 
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fflb=Y-^^ (0.12) 

Qh=^-^ (0.14) 

fflb =!+<*, (0.15) 

As will be appreciated, equations (0.12) to (O.IS) allow the angles ^ibm 
to be put into a reference frame that corresponds with the touch screen coordinate 
system. Moreover, the angles oCcam can be expressed as: 

Qr^=arctan ^°°"2^' (0.16) 

y cam y i 

Expressing the angles occani in terms of the angles co^, yields the expression: 


10 0)^ 


JX —X' 
_Sss. L 


(0.17) 


L y cam y i _ 

Equation (0.17) therefore provides a way of fitting the angles (fltam in a 
manner that allows the rectangular coordinates (xi, yi) of a pointer in close proximity 
to the touch screen as well as the offset angles 5cam of the digital cameras DCcam to be 
calculated provided an angle ^cam corresponding to at least one pointer contact point 

15 on the touch surface 60 is available. This is due to the fact that for a given contact on 
the touch surface, the angles (flfcam can be calculated using equations (0.12) to (0.15), 
the coordinates (xcam, ycam) of the digital cameras DCcam with respect to the touch 
screen coordinate system are known and the pointer coordinates (Xi.yO are the same 
for each digital camera. However, since equation (0.17) is nonlinear in the 

20 coordinates (Xi, yi), it is necessary to use a linearization technique to fit the angles 

COfcam- 

Therefore in accordance with the present invention, during calibration 
of the touch system 50, a pointer is used to contact the touch surface 60 at a plurality 
of contact points. Assuming that each contact point is within the field of view of each 
25 digital camera DCcam, for each contact point (xj, yi) on the touch surface 60, the angles 
to ci>) are calculated. Using equation (0.17), a system of equations is developed. 
From the system of equations, the coordinates of each contact point (Xj, yO and the 
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offset angle beam of each digital camera DCcamCan be determined using a nonlinear 
least-squares technique. Depending on the number of contact points used during the 
calibration, the system of equations may be over-detennined or under-detennineA 

To unify the treatment of the system of equations regardless of whether 
5 the system of equations is over-determined or under-determined, the Moore-Pfenrose 
pseudo-inverse method that is based on singular value decomposition (SVD) is used 
to determine a least squares solution. 

As will be appreciated, a matrix can always be deconq>osed in the 
following way: 

10 A^USV^ (0.18) 

Matrix A can have any sh^. The matrices U and V are orthogonal 
matrices, meaning that: 

The diagonal matrix S is composed entirely of the singular values of 
15 matrix A , which are related to the squares of the eigenvalues of matrix A . The 

importance of the singular value decomposition (SVD) lies in the fact that with it, the 
inverse of matrix A can always be conQ>uted Moreover, it is possible to control this 
inversion when a poorly determined problem is encountered. Consider the system of 
linear equations: 

20 Ax = b 

whose solution would be: 
x^A-'b 

SVD allows the inverse of matrix A to be written as: 

A-'^VS-'U"^ (0.19) 
25 since both matrices U and V are orthogonal. In a poorly determined situation, some of 
the singular values will be very small, so that when matrix 5"' is fomnted, large values 
will be produced, which is not desirable. In this case, the inverses of the smallest 
singular values are set to zero. This has the effect of eliminating the pooriy 
determined part of the solution. For least-squares problems, this is a powerful tool. 
30 The usual normal equations method for least-squares problems is based on solving: 

A^Ax^A^B (0.20) 

jc = {A'^A)"'A'^6 
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in the over-detennined case, and solving: 

x^A^{AA^y'5 (0.21) 

in the under-determined case. As a result, the soludon to the system of equations in 
either the underdetermined or overdetermined case can be determined using one 
5 procedure. 

Once the offset angles 6cam for the digital cameras DCcam are known, 
the offset angles Scam are stored in memory by the master controller 54. During 
operation of the touch system 50, when tiie master controller 54 is calculating the 
angles <|^, the actual offset angles 5cam of the digital cameras are used to adjust the 
10 results. Thus, when triangulation is performed by the master controller 54 using the 
calculated angles ^cam to determine the position of die pointer relative to the touch 
surface 60, the calculated position accurately reflects the actual position of the pointer 
relative the touch surface 60. This is due to die fact that die angles <|tam arc referenced 
to designated peripheral edges of the touch screen and hence, the touch screen 
15 coordinate system. 

Although the touch system 50 has been described as including a 
projector to project images on die touch screen, diose of skill in die art will appreciate 
Uiat diis is not required. The touch screen may be transparent or translucent and 
placed over a display unit so that the display presented on the display unit is visible 
20 through die touch screen. Also, die touch screen need not be a rectangular sheet of 
material bordered by a frame. The touch screen may in fact be virtually any surface 
within overlapping fields of view of two or more cameras. 

Although the Moore-Pfcnrose pseudo-inverse method has been used to 
fit the angles ©cam to equation (0.17), diose of skill in die art will appreciate tiiat other 
25 madiematical linerization techniques may be used. For exanq)le, the angles a>cain can 
be fitted to equation (0.17) using the second-order Newton least squares method or the 
Gauss-Newton least squares method. 

Although the touch system 50 is shown as including four digital 
cameras, one located adjacent each comer of the touch screen, the calibration method 
30 applies to touch systems widi different numbers of cameras. For exanq)le. Figure 3 
shows a touch screen 52' including only two DSP-based digital cameras DC'cam. In 
order to determine the digital camera offsets 6 for the digital cameras, it is first 
necessary to define a coordinate system for die touch screen. In diis example, digital 
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camera DC'j is taken to be at the origin of the coordinate system with the x axis 
pointing to the right and the y axis pointing downward. This convention is used so 
that the vertical touch screen dimension is eliminated 


From the Figure 3, it can be seen that the angles 0^ are defined by: 

(1.1) 


tanA 


tan^= ^ 

where is the horizontal distance between the digital canteras DC'i, and DC'j- By 
solving these equations for x and y, initial estimates are found to be: 

^_ g.tan^ 

tan^+tan^ 2) 

y = -^—r^ — P-=jctan^ 
tan^ +tan^ 

The information required now is just the elements of the design matrix, including 
terms for a variable B^ . Expressing diese as the gradients of the appropriate functions 
yields: 


V<iii(jf.y) = 


B.-x -y 


(B,-;c)^/ 

All this means is that there is an extra column in the design matrix conesponding to 
the change in . 

It is necessary to define angles Cflfcam and the offset angles Scam carefully 
in this case. For the present problem, the angles oofeamare expressed as: 

^i=Y-<*i (1.3) 

^y2=|+<*2 (1.4) 

Also, the correct sense of the offset angles is obtained by adding 180 degrees to 
their final values and then reversing their signs. 

As the present system of equations is underdetermined, a least squares 
minimum-norm solution is adopted. There are 1 1 unknowns to be determined from 8 
measurements. Hie correction vector Jc is found from: 
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(1.5) 


In addition to having the two digital cameras located at the comets of 
the touch screen 52', die digital cameras DC'camioay be positioned relative to the 
touch screen in the configuration shown in Hgure 4. In this exaiiq>le, a diagonal 
distance d separates the digital cameras. If digital camera DC'i is located at (x,,0) 

and digital camera DC'2 at (0, ) , then d the distance d is given by: 


Hie angles ^icam are defined by: 


tan^,=— ^ (1.6) 
tan^j=-^^i^ (1.7) 


Solving for {x,,y,) gives: 


(1.8) 

tanf),-tan^2 


The above equations are good initial estimates although a general equation for the 
angles <|) cam can be written as: 


(2.0) 


where a camera offset angle has been introduced. 

It is possible to do a calibration solution using a single point. This is 

achieved by writing defining equations for the angles «>caffl as follows: 

/ = tan«», ^ (2.1) 

5 = tan^j-.^^i^ (2.2) 
Assuming that die angles (> cam are known, the solution {x„y,) can be treated as the 
roots of the system of simultaneous equations. Newton's method for two variables is: 
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As will be appreciated, the present system allows the camera offsets 
5 relative to a Cartisian reference frame to be determined so that the position of an 
object in Cartisian co-ordinates within overlapping fields of view of a pair of cameras 
relative to a surface within the reference frame can be accurately determined 

Although preferred embodiments of the present invention have been 
described, those of skill in the art will appreciate that variations and modifications 
10 may be made without departing from the spirit and scope thereof as defined by the 
appended claims. 
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What is claimed is: 

1 . A method of determining the position of an object relative to a 
reference frame from captured images of the object based on triangulation, the 

S captured images being taken by at least two cameras having overlapping fields of 
view within said reference irame, at least one of said cameras having an offset angle 
causing an extremity of the field of view thereof to extend beyond a boundary of said 
reference frame, said method comprising the steps of: 

capturing an image of the object using each said at least two cameras at 
10 at least one location within said reference frame; 
for each location: 

determining the position of the object within each image and 
for each image placing the determined position into a coordinate system 
corresponding to that of said reference frame; and 
15 processing the determined positions to determine at least one of the 

position of the object at each location and the offset angle of said at least one camera. 

2. The method of claim 1 wherein the determined position of the object 
within each image is represented by an angle 0 , said angle being equal to the angle 

20 formed between the extremity of the field of view extending beyond the reference 
frame boundary and a line extending from the camera that intersects the object within 
the image. 

3. The method of claim 2 wherein during said processing each said angle 
25 is converted into a rectangular (Xi.yO position within the reference frame coordinate 

system. 

4. The method of claim 3 wherein captured images are acquired by 
cameras at the comers of a rectangular reference frame, each of said cameras having a 

30 field of view offset with respect to said reference frame, during said processing each 
said angle ^ is converted to an angle co, said angle o) being represented by: 
a) = a-S 

where: 


10 
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S is the camera offset; and 

a is equal to the angle (p with the camera offset removed and 
references to the y-axis of the reference frame coordinate system and wherein each 
said angle O) is fitted to the equation: 


CO 

cam 


L y cam y t . 


where: 


Xcam and yearn are the rectangular coordinates of the camera; and 
Xi and yi arc the rectangular coordmates of the object, Aereby to yield 
the rectangular position (Xj, y^) and the camera offset. 

5. The method of claim 4 wherein the fitting is performed using a 

linearization technique. 


6. The method of claim S wherein said linearization technique is the 

15 Moore-Penrose pseudo-inverse method. 


7. A method of detenxiining the position of an object relative to a 

reference frame from captured images of the object based on triangulation, the 
captured images being taken by at least two cameras having overlapping fields of 

20 view within the reference frame, an extremity of the field of view of each said at least 
two cameras encompassing a boimdary of said reference frame, at least one of said 
cameras being offset causing the extremity of the field of view thereof to extend 
beyond said boundary, said method comprising the steps of: 

determining the position of the object within each image, the position 

25 of the object within each image being represented by an angle, said angle being equal 
to the angle formed between the extremity of the field of view encompassing the 
boundary of said reference frame and a line extending from the camera that intersects 
the object within the image; 

determining the offset angle of said at least one camera; 

30 subtracting the offset angle from the angle representing the position of 

the object within the image taken by said at least one camera to calibrate the angle; 
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using the calibrated angles to calculate the position of the object with 
respect to the reference frame using triangulation. 

8. The method of claim 7 wherein each said at least two cameras is offset, 
5 the offset angle for each said at least two cameras being determined and used to 

calibrate the angles. 

9. In a touch system including at least two cameras having overlapping 
fields of view and a processor to process image data of said at least two cameras, 

10 where the position of an object that is within the overlapping fields of view relative to 
a reference firame is determined by triangulating object position data captured in an 
image acquired by each camera, a method of calibrating the touch system comprising 
the steps of: 

determining the offset angle of each camera relative to the reference 

15 frame; 

using the offset angle to calibrate the object position data; and 
using the calibrated object position data during triangulation to 
determine the position of said object relative to said reference frame. 

20 10. In a touch system including a reference frame, and at least two cameras 

having fields of view that overlap within said reference frame, wherein the position of 
an object relative to the reference frame is determined from captured images of the 
object based on triangulation, and wherein the fields of view of said at least two 
cameras are rotated with respect to the coordinate system of said reference firame to 

25 define offset angles, a method of calibrating said touch system comprising the steps 
of: 

capturing an image of the object using each said at least two cameras at 
at least one location within said reference frame; and 
for each location: 

30 determining the position of the object within each image, the 

position of the object within each image being represented by an angle ^, said angle 
being equal to die angle formed between an extremity of the field of view extending 
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beyond the reference frame and a line extending from the camera that intersects the 
object within the image; and 

mathematically calculating the offset angles of said at least two 
cameras based on the angle determined for each image and the position of said at least 
5 two cameras relative to the coordinate system assigned to said reference frame. 

1 1 . The method of claim 10 wherein the offset angle of each camera is 

calculated using a least squares method. 

10 12. A touch system comprising: 

a generally rectangular reference frame surrounding a touch surface, 
one comer of the reference frame defining the origin of a coordinate system assigned 
to said touch surface; 

a camera adjacent each comer of the reference frame, each camera 
15 being aimed towards said touch surface and capturing images of said touch siuf ace 
within the field of view thereof, fields of view of said cameras overlapping within 
said reference frame, the fields of view of said cameras being offset with respect to 
said reference frame; and 

a processor processing the captured images and generating object 
20 position data when an object appears in images, said processor determining the 
position of said object relative to said origin in rectangular coordinates using said 
object position data based on triangulation, wherein said processor further executes a 
calibration routine to determine offset angles of said cameras, said offset angles being 
used by said processor to adjust said object position data prior to said position 
25 determination. 

13. A computer readable media including a computer program thereon for 

determining the offset angles of cameras at different positions along a reference 
rectangular coordinate system based on object position data generated by said 
30 cameras, the object position data generated by each camera representing the position 
of an object within the field of view of said each camera at least one location within 
the fields of view of said cameras, said computer program including: 

computer program code for relating the object position data generated 
by each camera to said rectangular coordinate system; and 
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computer program code for mathematically calculating the offset 
angle of each camera based on the related object position data and the position of said 
cameras relative to said coordinate system. 

5 


